Mobile device display and input expansion apparatus

ABSTRACT

An input/output expander for a mobile device has a communications module connectible thereto. Output display signals from the mobile device and input signals to the mobile device are relayed between the mobile device and the bi-directional projection unit by the communications module. A display output projector is connected to the communications module, and the output display signal from the mobile device is converted to a first series of light outputs corresponding to the output display signal. The expander has a virtual keyboard projector generating a second series of light outputs corresponding to a virtual keyboard key arrangement. A key input sensor with a sensing coverage area encompassing the virtual keyboard key arrangement detects user input at specific positions thereon. A key input value corresponding to a specific key of the virtual keyboard key arrangement is generated.

CROSS-REFERENCE TO RELATED APPLICATIONS

Not Applicable

STATEMENT RE: FEDERALLY SPONSORED RESEARCH/DEVELOPMENT

Not Applicable

BACKGROUND 1. Technical Field

The present disclosure relates generally to multi-purpose mobilecomputing devices, and more particularly, to an apparatus for expandingthe input and display output capabilities of mobile devices.

2. Related Art

A variety of personal computing devices spanning a wide range of formfactors are available, with each fulfilling specific needs andapplications. Evolved from general-purpose desktop computers,notebook/laptop computers feature a clamshell form factor with a baseportion incorporating the processor, memory, storage, and peripheralinput/output ports. A keyboard and/or a trackpad or other like graphicaluser interface input modality may be disposed on the interior face ofthe base clamshell portion. The other half of the clamshell may bededicated to the display. Such notebook computers are loaded withdesktop-class operating systems and software applications, and has localarea networking connectivity over Ethernet and WiFi.

At the other end of the portability spectrum are smartphones thatcombine the features of earlier cellular phones and personal digitalassistants. Such devices are equipped with a general purpose dataprocessor that executes pre-programmed instructions. Althoughdifferences between processors utilized in mobile devices and thoseutilized in desktop and notebook class personal computers are becomingless, earlier mobile processors were lower powered due to limitedbattery capacity, small form factors, and so on.

A fundamental design consideration of a smartphone is communications, soa typical smartphone incorporates multiple communications modules. Theseinclude longer range cellular network modalities such as GSM (GlobalSystem for Mobile Communications), UMTS (Universal MobileTelecommunications System, EDGE (Enhanced Data Rates for GSMEvolution)/LTE (Long Term Evolution), 5G, and the like. For connectingto wireless local area networks, smartphones may also incorporate aWi-Fi module, while a Bluetooth module may be included for connecting toperipheral devices such as headsets, speakers, smartwatches, activitymonitors, and the like over short distances.

The processor cooperates with multiple input/output devices, includingcombination touch input display screens, audio components such asspeakers, microphones, and related integrated circuits, GPS modules,physical buttons/input modalities, and cameras. Recent devices alsoinclude accelerometers, magnetometers, barometers, gyroscopes and otherphysical sensors that can sense motion and direction to provide asinputs to an interactive software application.

The processor core or cores, the wireless modems implementing thecommunications modalities, along with graphics processing units andother dedicated processors for such functions as security, imageprocessing, and so on, may be incorporated into a single system-on-chip(SoC). One example of a SoC platform is the Qualcomm Snapdragon system.The management of the aforementioned hardware components is performed bya mobile operating system. The mobile operating system provides severalfundamental software modules and a common input/output interface thatcan be used by third party applications via application programminginterfaces. One widely utilized mobile operating system is GoogleAndroid.

The tablet is another popular mobile device form factor. Tabletstypically utilize the same hardware and software components of asmartphone, that is, the same SoC system, the same operating system, andrun the same software, except with the display and overall device sizebeing larger than a smartphone. Like the smartphone, tablets have aslate form factor that have few, if any, physical buttons, with thetouch display screen occupying much of the front face of the device.

User interaction with these mobile devices, including the invoking ofthe functionality of these applications and the presentation of theresults therefrom, is, for the most part, restricted to the graphicaltouch user interface. That is, the extent of any user interaction islimited to what can be displayed on the screen, and the inputs that canbe provided to the touch interface are similarly limited to what can bedetected by the touch input panel. Touch interfaces accept user inputsin the form of tapping, sliding, flicking, and pinching regions of thesensor panel overlaying the displayed graphical elements with one ormore fingers. The graphical user interface may responsively generatecorresponding animated display reactions thereto.

While the availability of productivity software applications fortablets, smartphones, and other mobile platforms are almost on par withthose available for personal computers, the smaller form factor of themobile devices tend to limit their use in such applications. Personnelwho must continue to work and use productivity applications whiletraveling out of the office/home office, such as sales professionalsvisiting customers and prospective customers, therefore must carry theentire range of computing devices. At a bare minimum, the smartphone islikely needed for telephone calls and sending/receiving e-mails, SMS(Short Messaging Service) or other instant messaging text messages,and/or workplace collaboration messages, and basic personal digitalassistant-type functions such as calendaring and to-do lists. Thenotebook computer may be needed for research, document generation, andpresentation purposes, while a tablet (with a digitizer, stylus, orother pen-style input device) may be utilized for reviewing and signingdocuments.

Each of additional device that must be carried is another weight burden,so there is a need in the art for reducing the overall number ofcomputing devices that a knowledge worker utilizes to continue workingwith optimal productivity. With the computing power incorporated intoconventional smartphones, it would be desirable to utilize the same forthe entire range of computing tasks while circumventing the reduced formfactor limitations impacting inputs and display outputs.

BRIEF SUMMARY

The present disclosure provides an apparatus for leveraging a singledevice, that is, a smartphone or other mobile communications device as aprimary computer, instead of using a laptop or similar device thatintegrates multiple components such as the processor, the video card,and others that are largely redundant with those correspondingcomponents in the mobile device. Accordingly, users need not berestricted to a single laptop or desktop computer, and simply utilizethe smartphone as the single computing device while expanding thedisplay output to a larger area, and expanding the input capabilities toa larger, virtual keyboard arrangement. Various embodiments of thepresent disclosure are contemplated to provide cost savings to users,and security problems can be minimized because the processing unit isphysically separable from the display and input modalities when notbeing used. Additionally, added convenience to end users may be achievedsince the single device involved, e.g., the smartphone, is ubiquitous inthe conventional technology ecosystem.

One embodiment of the present disclosure is directed to a mobile deviceinput and output display expansion apparatus. There may be a clamshellstructure including a first section in a hinged relationship to a secondsection. The first section may define a flat display projection surface,while the second section may define a docking recess and a keyboardprojection surface. The apparatus may also include a bi-directionalprojection unit, which may have a communications module that isconnectible to a mobile device. Output display signals from the mobiledevice and input signals to the mobile device may be relayed between themobile device and the bi-directional projection unit by thecommunications module. The bi-directional projection unit may alsoinclude a display output projector connected to the communicationsmodule. The output display signal from the mobile device may beconverted to a first series of light outputs corresponding to the outputdisplay signal and projected against the flat display projection surfaceof the clamshell structure. There may also be a virtual keyboardprojector that generates a second series of light outputs correspondingto a virtual keyboard key arrangement and projected against the keyboardprojection surface of the second section of the clamshell structure. Thebi-directional projection unit may further incorporate a key inputsensor that covers the virtual keyboard key arrangement to detect hapticinput at specific positions along the virtual keyboard key arrangement.The key input sensor may generate a key input value corresponding to aspecific key of the virtual keyboard key arrangement at which the hapticinput is detected. Furthermore, the key input value may be relayed tothe mobile device by the communications module. The bi-directionalprojection unit may also include a housing at least partially receivedin the docking recess. The housing may be defined by a first edge with adisplay projector aperture to the display output projector. The housingmay also be defined by an opposed second edge with a keyboard projectionaperture to the virtual keyboard projector and an input sensor apertureto the key input sensor.

According to another embodiment of the present disclosure, there may bean input/output expander for a mobile device. The expander may have acommunications module connectible to the mobile device. Output displaysignals from the mobile device and input signals to the mobile devicemay be relayed between the mobile device and the bi-directionalprojection unit by the communications module. There may also be adisplay output projector that is connected to the communications module.The output display signal from the mobile device may be converted to afirst series of light outputs corresponding to the output displaysignal. The expander may also include a virtual keyboard projectorgenerating a second series of light outputs corresponding to a virtualkeyboard key arrangement. There may further be a key input sensor thatdefines a sensing coverage area encompassing a projection of the virtualkeyboard key arrangement to detect user input at specific positionsthereon. The key input sensor may generate a key input valuecorresponding to a specific key of the virtual keyboard key arrangementat which the user input is detected. The key input value, in turn, maybe relayed to the mobile device by the communications module.

Yet another embodiment of the present disclosure contemplates a mobilecommunications device received within an input/output expander. Themobile communications device may include a data processor and a devicehousing defined by a front face and a plurality of edges. A primarydisplay may be mounted to the device housing as a part of the front facethereof. There may also be a display output projector connected to thedata processor. An output display signal from the processor may beconverted to a first series of light outputs corresponding to the outputdisplay signal. An output window of the display output projector may bedefined in a first one of the plurality of edges of the device housing.The mobile communications device may further include a virtual keyboardprojector that generates a second series of light outputs correspondingto a virtual keyboard key arrangement. An output window of the virtualkeyboard projector may be defined in a second one of the plurality ofedges of the device housing. Furthermore, there may be a key inputsensor that defines a sensing coverage area encompassing a projection ofthe virtual keyboard key arrangement to detect user input at specificpositions thereon. The key input sensor may generate a key input valuecorresponding to a specific key of the virtual keyboard key arrangementat which the user input is detected. The key input value may be passedto the data processor. A sensor window of the key input sensor may alsobe defined in the second one of the plurality of edges of the devicehousing.

The present disclosure will be best understood accompanying by referenceto the following detailed description when read in conjunction with thedrawings.

BRIEF DESCRIPTION OF THE DRAWINGS

These and other features and advantages of the various embodimentsdisclosed herein will be better understood with respect to the followingdescription and drawings, in which like numbers refer to like partsthroughout, and in which:

FIG. 1 illustrates a mobile device input and output display expansionapparatus in accordance with one embodiment of the present disclosure;

FIG. 2 is a top plan view of clamshell panels utilized in the mobiledevice input and output display expansion apparatus with a projectionunit positioned therein;

FIG. 3 is a side view of the clamshell panels utilized in the mobiledevice input and output display expansion apparatus;

FIG. 4 is bottom plan view of the clamshell panels;

FIG. 5A is a front perspective view of a projection unit in accordancewith one embodiment of the present disclosure;

FIG. 5B is a rear perspective view of the projection unit;

FIG. 6 is a block diagram of a first embodiment of the projection unit;

FIG. 7 is a block diagram of a second embodiment of the projection unitthat omits cooling fans;

FIG. 8 is a block diagram of a third embodiment of the projection unitthat includes an external key input sensor; and

FIG. 9 is a block diagram of a fourth embodiment of the projection unitthat connects directly to a mobile device for power and graphics output.

DETAILED DESCRIPTION

The detailed description set forth below in connection with the appendeddrawings is intended as a description of the several presentlycontemplated embodiments of a mobile device display and input expansionapparatus and is not intended to represent the only form in which suchembodiments may be developed or utilized. The description sets forth thefunctions and features in connection with the illustrated embodiments.It is to be understood, however, that the same or equivalent functionsmay be accomplished by different embodiments that are also intended tobe encompassed within the scope of the present disclosure. It is furtherunderstood that the use of relational terms such as first and second andthe like are used solely to distinguish one from another entity withoutnecessarily requiring or implying any actual such relationship or orderbetween such entities.

With reference to FIG. 1, one embodiment of the present disclosure isdirected to a mobile device input and output display expansion apparatus10. In accordance with this illustrated embodiment, the apparatus 10communicates with a mobile device 12, and expands the output and inputcapabilities of the mobile device 12. The mobile device 12 is understoodto be a smartphone, tablet, or other like mobile communications devicewith a smaller physical footprint, though incorporating a range of dataprocessing and communications features.

The mobile device 12 incorporates a general-purpose data processor thatexecutes pre-programmed software instructions that are loaded into anonboard memory module. There may be non-volatile memory on whichsoftware and other data are stored. Such software instructionscorrespond to various software applications such as e-mail, wordprocessing, web browsing, and slideshow presentation. Such dataprocessor may be part of a system-on-chip (SoC) mobile platform such asthe Qualcomm Snapdragon discussed earlier, which additionally includesdedicated graphics processors, a wireless modem, a digital signalprocessor and other input/output functionalities, and so on. Utilizingthe general-purpose wireless modem as the base, various short-rangewireless communications and cellular communications may be implemented.Typical mobile devices 12 implement one or more versions of WiFi andBluetooth, along with mobile communications such as GSM (Global Systemfor Mobile communications) and others also discussed above.

As an intermediate layer between the hardware and the user softwareapplications, the mobile device 12 may have an operating systeminstalled thereon that manages all of the onboard hardware devices andprovide a consistent application programming interface thereto. Oneexample operating system is the Google Android, though devices withApple iOS may be substituted. Additional specifics of the mobile device12 will be omitted, as those having ordinary skill in the art willreadily appreciate the myriad of features and functionalities that maybe incorporated therein.

The face of the mobile device 12 is dominated by a touch display screen14, which serves as both the primary output and primary input for themobile device 12. The touch display screen 14 may be implemented with anunderlying light emitting diode display, on which a capacitive sensormatrix is overlaid. Despite the display occupying almost the entirety ofthe mobile device 12, the size limitations of the device itself mayrestrict visibility of the graphics display. Inputting text data istypically achieved via an on-screen keyboard, which may occupy up to aquarter or a third of available screen real estate. Again because of thesmaller device size, typing on on-screen keyboards may be limited to thethumbs, rather than all ten fingers. Other inputs to invoke thefunctionality of the software applications may be provided by on-screenbuttons, icons, and the like. However, the limited screen real estateinvolves particular graphical user interface design considerationsspecific thereto.

With the improved processing capabilities of the mobile device 12, it iscontemplated to be used for functions typically requiring laptop ordesktop computers. The input and output capabilities of the mobiledevice 12 continue to be limiting factors, though with the mobile deviceinput and output display expansion apparatus 10 of the presentdisclosure, such limitations may be avoided. As illustrated in FIGS. 1,2, and 3, the apparatus includes a clamshell panel or structure 16 witha first section 18 that is in a hinged relationship to a second section20. That is, the first section 18 is rotatably connected to the secondsection 20 with a hinge section 21. According to one embodiment, thehinge section 21 is a resiliently flexible material connected to thefirst section 18 and the second section 20. However, any other hingestructure that allows the first section 18 to be fixed at a desiredangle relative to the second section 20 while being foldable with asufficient amount of force may be readily substituted without departingfrom the present disclosure. The hinge section 21 may have a sufficientarticulation range to enable the first section 18 to close upon thesecond section 20, reducing the overall footprint to that of firstsection 18 or the second section 20 by itself.

Both the first section 18 and the second section 20 have a generallyrectangular shape, with each including a rear cover surface 18 a, 20 a,and an opposite front display surface 18 b, 20 b. The front displaysurface 18 b of the first section 18 may also be referred to as a flatdisplay projection surface because, as will be described in furtherdetail below, the display output is projected thereto. Likewise, thefront display surface 20 b of the second section 20 may be referred toas a keyboard projection surface because the virtual keyboard isprojected thereto. The first section 18 and the second section 20 may beconstructed of a thin, rigid plastic material, or metal. In a preferred,though optional embodiment, the thickness of the material used for thefirst section 18 and the second section 20 may be 1/16″ to 3/16″ thick.These structural features, including the rectangular shape of the firstsection 18 and the second section 20, are presented by way of exampleonly and not of limitation. Other profiles such as a flattened oblongshape, flattened egg, or any other flattened shape may be substitutedwithout departing from the scope of the present disclosure.

The second section 20 further defines a docking recess 22 that accepts abi-directional projection unit 24. The docking recess 22 may be sizedand shaped to correspond to that of the bi-directional projection unit24. Other embodiments of the present disclosure contemplate the mobiledevice 12 itself being the bi-directional projection unit, or aperipheral device that attaches to or is fitted to the mobile device 12.In such embodiments, the docking recess 22 is understood to be sized andshaped for mobile device 12 or the peripheral device. The second section20 of the clamshell structure 16 may also incorporate locking mechanismsto retain the bi-directional projection unit beyond just frictionalretention. Those having ordinary skill in the art will recognize that avariety of locking mechanisms may be utilized.

Referring now to FIGS. 5A and 5B, the bi-directional projection unit 24has a housing 26 with a rectangular in an exemplary configuration. Thereis a first lengthwise edge wall 28 and an opposed second lengthwise edgewall 30. Furthermore, there is a left sidewall 32 and an opposed rightsidewall 34, each of which are perpendicular to the first lengthwiseedge wall 28 and the second lengthwise edge wall 30. The firstlengthwise edge wall 28 defines a first projector aperture 36 to adisplay output projector. The first projector aperture 36 and thedisplay output projector behind it faces the front display surface 18 bof the clamshell structure 16 when the bi-directional projection unit 24is positioned within the docking recess 22. The second lengthwise edgewall 30 defines a virtual keyboard projection aperture 38, a firstsensor aperture 40 toward the right sidewall 34 and a second sensoraperture 42 toward the opposite left sidewall 32. Behind the virtualkeyboard projection aperture 38 is a virtual keyboard projector facingthe front display surface 20 b of the clamshell structure 16.

With additional reference to the block diagram of FIG. 6, thebi-directional projection unit 24 includes a pico projector 44, whichcorresponds to the aforementioned display output projector. The picoprojector 44 is understood to generate a first series of light outputscorresponding to the display video from a video source. A variety oftechnologies may be utilized to implement the pico projector 44,including an imager that converts an electronic signal corresponding tothe display output to drive a series of laser or LED light sources, withindividual color light emissions that are combined with a combineroptic. There are several well-known types of imagers known in the art,including Digital Light Processing (DLP) from Texas Instruments, laserbeam steering, and liquid crystal on silicon.

The light output from the pico projector 44 is passed through anadditional diffractive optical element 46. The focus of the diffractiveoptical element 46 may be adjusted by a set of focusing gears 48. Thediffractive optical element 46 is understood to be aligned with thefirst projector aperture 36 defined on the first lengthwise edge wall 28of the housing 26. The light outputs from the pico projector 44 are thusprojected against the flat display projection surface of the clamshellstructure 16, that is, the front display surface 18 b. The focusdistance may be different depending on the articulated position of thefirst section 18 relative to the second section 20, so the focusinggears 48 are understood to compensate for any variations. The focusinggears 48 may be manually manipulated for a desired focus, thoughautomated focusing with additional sensors (infrared for distancemeasurement, or image capture for phase detection or contrast detection)may also be implemented.

Before the light output is generated, the electrical signal that isconverted to the light output by the pico projector 44 may be generatedfrom a graphics output processor 50. Such electrical signals may begenerated from a video output signal from a source, e.g., the mobiledevice 12. In this regard, the bi-directional projection unit 24 mayalso include a communications module 52 with a modem having bothwireless and wired connection interfaces. One possible wirelessinterface is WiFi and therefore there may be a WiFi transceiver 54,while one possible wired interface is USB (Universal Serial Bus) andtherefore there may be a USB module 56. A standard USB-A, B, or C typesocket may be incorporated, to accept a corresponding USB plug that isthe terminus of an input/output link cable. Alternative physicalinterfaces between the USB module 56 and the mobile device 12 may bereadily substituted without departing from the present disclosure.

According to one embodiment, the mobile device 12 transmits a videooutput stream that is received by the communications module 52, and suchstream may, in turn, be converted to the electrical signalscorresponding to the video by the graphics output processor 50. Theconnection interfaces and the integrated circuits that implement thesemodules may be mounted to a printed circuit board 58.

The pico projector 44 is mounted to, or adjacent or otherwise inproximity to a pair of thermal conductors or heat sinks 60 a, 60 b totransfer away the heat generated thereby. The heated air in the housing26 may be moved out the interior by one or more fans 62. In an exemplaryembodiment, there may be a first fan 62 a located centrally in theinterior of the housing 26, and a second fan 62 b located toward theleft sidewall 32 adjacent to the heat sink 60 a.

Having considered the features of the apparatus 10 that expand theoutput display capabilities of the mobile device 12, the features thatexpand the input capabilities will now be considered. Still referring tothe diagram of FIG. 6, there is a laser diode projector 64 thatcorresponds to the aforementioned virtual keyboard projector. The laserdiode projector 64 generates a second series of light outputscorresponding to a virtual keyboard key arrangement 66. Specifically, asshown in FIGS. 1 and 2, this is understood to be an arrangement ofcolumns and rows of keys that are the same as a conventional keyboard.Each block is understood to correspond to a specific character key, andthe boundaries between each block are generated by the laser diodeprojector 64. The light outputs of the virtual keyboard are projectedagainst a keyboard projection surface of the second section 20 of theclamshell structure 16, that is, the front display surface 20 b. In thisregard, there may be another set of diffractive optic elements 68aligned with the output end of the laser diode projector 64 and thevirtual keyboard projection aperture 38 defined in the second lengthwiseedge wall 30 of the housing 26.

One embodiment contemplates a virtual keyboard key arrangement 66 thatremains static and no changes are possible to the size, shape, andlayout of virtual keys. Accordingly, for such embodiment, the laserdiode projector 64 may be pre-programmed for this specific arrangement,and no communication with the mobile device 12 is necessary. However,alternative embodiments also contemplate the ability for a user tochange the arrangement of the virtual keys, e.g., changing from a QWERTYto a Dvorak style keyboard, changing between region or language specifickey characters and arrangements, or changing between PC-styleAlt/Ctrl/Paste/Function key arrangements and Mac-style Alt/Ctrl/Commandkey arrangements. In such configurations, the multiple display outputsfor the different virtual keyboard key arrangement may be stored in anseparate integrated circuit module connected to the laser diodeprojector and selected via a command transmitted through thecommunications module 52. Still further, like the graphics outputprocessor 50, the mobile device 12 may dictate what is being output bythe laser diode projector 64 at any given time. Alternativeconfigurations besides the foregoing may also be implemented withoutdeparting from the scope of the present disclosure.

Like the pico projector 44, the laser diode projector 64 may be mountedto a pair of thermal conductors or heat sinks 60 c, 60 d to transferaway the heat generated thereby. The heated air in the housing 26 may bemoved out the interior by the centrally located first fan 62 a.

With the virtual keyboard key arrangement 66 projected on to the frontdisplay surface 20 b, it is possible for the user to input keystrokes byplacing finger at a given one of the locations at which thecorresponding virtual key is being projected. The break in the laserprojection is detected by a key input sensor or more specifically the IRdetector 70. The key input sensor generates a key input value thatcorrespond to a key of the virtual keyboard key arrangement 66 at whichthe user haptic input is detected. This input key input value, in turn,is passed to the communications module 52 for transmission to the mobiledevice 12. The IR detector 70 is positioned within the housing 26 to bealigned with the second sensor aperture 42.

The first sensor aperture 40, on the other hand, is aligned with a CMOSimaging sensor 72, which captures a sequence of images within its fieldof view, e.g., the virtual keyboard key arrangement 66. The imagescaptured by the CMOS imaging sensor 72 may be processed to determinewhen and which keys were activated, and transmits the information as akey input value to the mobile device 12 via the communications module52.

The IR detector 70 and the CMOS imaging sensor 72 are understood togenerate signal and/or data corresponding to the haptic input withoutfurther processing as to what specific key of the virtual keyboard keyarrangement 66 was “pressed.” These signals/data are passed to an inputprocessor 74 that applies a series of processing steps to determine thespecific key press. The input processor 74 may then generate a standard(ASCII) key value that corresponds to the detected key press, and passesthe same to the communications module 52 for transmission to the mobiledevice 12.

According to an embodiment of the present disclosure, the components ofthe bi-directional projection unit 24, e.g., the pico projector 44, thelaser diode projector 64, associated circuitry including the graphicsoutput processor 50, the communications module 52, and the inputprocessor 74, as well as the fans 62 may be powered by an onboardbattery 76. There may also be a charging circuit 78 that charges theonboard battery 76 via a separate connection or via the USB module 56.As will be described in the context of alternative embodiments, however,the onboard battery 76 is optional.

FIG. 7 illustrates a second embodiment 24 b of the bi-directionalprojection unit that likewise includes the pico projector 44 thatgenerates a first series of light outputs corresponding to the displayvideo from a video source. Like the first embodiment discussed above,the light output from the pico projector 44 is passed through theadditional diffractive optical element 46. The focus of the diffractiveoptical element 46 may be adjusted by the focusing gears 48. Thediffractive optical element 46 is aligned with the first projectoraperture 36 defined on the first lengthwise edge wall 28 of the housing26. The light outputs from the pico projector 44 are projected againstthe front display surface 18 b.

The light output is generated by the pico projector 44 from anelectrical signal that is generated by the graphics output processor 50,which in turn are generated from the video output from a source such asthe mobile device 12. The communications module 52 is the modality bywhich the video output is transferred from the mobile device 12 andincludes the WiFi transceiver 54 and the USB module 56. In furtherdetail, the mobile device 12 transmits a video output stream that isreceived by the communications module 52, and such stream is convertedto the electrical signals corresponding to the video by the graphicsoutput processor 50. The connection interfaces and the integratedcircuits that implement these modules may be mounted to the printedcircuit board 58.

The second embodiment of the bi-directional projection unit 24 similarlyincludes the laser diode projector 64 that generates the second seriesof light outputs corresponding to a virtual keyboard key arrangement 66.The light outputs of the virtual keyboard are projected against thefront display surface 20 b, also referred to as the keyboard projectionsurface of the second section 20 of the clamshell structure 16. The setof diffractive optic elements 68 are aligned with the output end of thelaser diode projector 64 and the virtual keyboard projection aperture 38defined in the second lengthwise edge wall 30 of the housing 26.

The second embodiment of the bi-directional projection unit 24 b alsoincorporates the IR detector 70 and the CMOS imaging sensor 72 thatdetermines key inputs that are captured by the input processor 74 andrelayed to the mobile device 12 by the communications module 52. Again,it is understood that the break in the laser projection from the laserdiode projector 64 is detected by the IR detector 70, and the CMOSimaging sensor 72 captures a sequence of images within its field of viewthat are processed to determine the haptic inputs upon the virtualkeyboard key arrangement 66. The IR detector 70 is positioned within thehousing 26 to be aligned with the second sensor aperture 42, while theCMOS imaging sensor 72 is positioned to be aligned with the first sensoraperture 40.

In this embodiment, the components of the bi-directional projection unit24 b, e.g., the pico projector 44, the laser diode projector 64,associated circuitry including the graphics output processor 50, thecommunications module 52, and the input processor 74 are powered by theonboard battery 76. There may also be a charging circuit 78 that chargesthe onboard battery 76 via a separate connection or via the USB module56.

The pico projector 44 is mounted to a pair of thermal conductors or heatsinks 60 a, 60 b to transfer away the heat generated thereby. Likewise,the laser diode projector 64 is mounted to a pair of thermal conductors60 c, 60 d, to transfer away the heat generated thereby. Unlike thefirst embodiment discussed above, however, the second embodiment doesnot include any fans, and relies entirely on the heat sinks 60 and itdirect or indirect thermal conduction to ambient air.

FIG. 8 illustrates a third embodiment 24 c of the bi-directionalprojection unit, which also incorporates the pico projector 44 thatgenerates a first series of light outputs corresponding to the displayvideo from a video source. Like the first and second embodimentsdiscussed above, the light output from the pico projector 44 is passedthrough the additional diffractive optical element 46, and the focus ofthe diffractive optical element 46 can be adjusted by the focusing gears48. The diffractive optical element 46 is aligned with the firstprojector aperture 36 defined on the first lengthwise edge wall 28 ofthe housing 26. The light outputs from the pico projector 44 areprojected against the front display surface 18 b.

As with the earlier described embodiments of the bi-directionalprojection unit 24, the light output is generated by the pico projector44 from an electrical signal that is generated by the graphics outputprocessor 50, which in turn are generated from the video output from asource such as the mobile device 12. The video output is transferredfrom the mobile device 12 by the communications module 52, whichincludes the WiFi transceiver 54 and the USB module 56. The mobiledevice 12 transmits a video output stream that is received by thecommunications module 52, and such stream is converted to the electricalsignals corresponding to the video by the graphics output processor 50.The connection interfaces and the integrated circuits that implementthese modules may be mounted to the printed circuit board 58.

The third embodiment of the bi-directional projection unit 24 similarlyincludes the laser diode projector 64 that generates the second seriesof light outputs corresponding to a virtual keyboard key arrangement 66.The light outputs of the virtual keyboard are projected against thefront display surface 20 b, and specifically the keyboard projectionsurface of the second section 20 of the clamshell structure 16. The setof diffractive optic elements 68 are aligned with the output end of thelaser diode projector 64 and the virtual keyboard projection aperture 38defined in the second lengthwise edge wall 30 of the housing 26.

The third embodiment of the bi-directional projection unit 24 c alsoincorporates the IR detector 70 that determines key inputs that arecaptured by the input processor 74 and relayed to the mobile device 12by the communications module 52. The user inputs keystrokes by placingfinger at a given one of the locations at which the correspondingvirtual key is being projected. The break in the laser projection isdetected by a key input sensor or more specifically the IR detector 70.The IR detector 70 is positioned within the housing 26 to be alignedwith the second sensor aperture 42.

Unlike the other embodiments, the CMOS imaging sensor 72 is mounted to aseparate platform 80 that may be raised above the plane of the housing26. As with the other embodiments, the CMOS imaging sensor 72 captures asequence of images within its field of view, e.g., the virtual keyboardkey arrangement 66, with those captured images being processed todetermine when and which keys were activated. The information may betransmitted as a key input value to the mobile device 12 via thecommunications module 52.

As discussed above, the IR detector 70 and the CMOS imaging sensor 72generates signal and/or data corresponding to the haptic input withoutfurther processing as to what specific key of the virtual keyboard keyarrangement 66 was “pressed.” These signals/data are passed to the inputprocessor 74 that applies a series of processing steps to determine thespecific key press.

The pico projector 44 is mounted to a pair of thermal conductors or heatsinks 60 a, 60 b to transfer away the heat generated thereby. Similarly,the laser diode projector 64 is mounted to a pair of thermal conductorsor heat sinks 60 c, 60 d to transfer away the heat generated thereby.The heated air in the housing 26 may be moved out the interior by one ormore fans 62, including the first fan 62 a located centrally in theinterior of the housing 26, and the second fan 62 b located toward theleft sidewall 32 adjacent to the heat sink 60 a.

Like the first and second embodiments discussed above, the components ofthe third embodiment of the bi-directional projection unit 24 c, e.g.,the pico projector 44, the laser diode projector 64, associatedcircuitry including the graphics output processor 50, the communicationsmodule 52, the input processor 74, the IR detector 70, and the CMOSimaging sensor 72 are powered by the onboard battery 76. The chargingcircuit 78 is understood to charge the onboard battery 76 via a separateconnection or via the USB module 56.

FIG. 9 illustrates a fourth embodiment 24 d of the bi-directionalprojection unit, which also incorporates the pico projector 44 thatgenerates a first series of light outputs corresponding to the displayvideo from a video source. Like the first, second, and third embodimentsdiscussed above, the light output from the pico projector 44 is passedthrough the additional diffractive optical element 46, and the focus ofthe diffractive optical element 46 can be adjusted by the focusing gears48. The diffractive optical element 46 is aligned with the firstprojector aperture 36 defined on the first lengthwise edge wall 28 ofthe housing 26. The light outputs from the pico projector 44 areprojected against the front display surface 18 b.

As with the earlier described embodiments of the bi-directionalprojection unit 24, the light output is generated by the pico projector44. In this embodiment, however, the bi-directional projection unit 24is incorporated into the mobile device 12, or itself includes a dockthat physically connects to the mobile device 12. Power for the variouselectronic components are provided by the mobile device 12, and themobile device connects directly to the pico projector 44 as anotheroutput display. Accordingly, no other graphics processor circuit isnecessary, or a communications module with various network/datatransmission capabilities. There is an input/output interface 82 that isconnected to the pico projector 44, the laser diode projector 64, the IRdetector 70, and the CMOS imaging sensor 72. The input/output interface82 is understood to be connectible to a corresponding interface on themobile device 12.

The input functionalities of the mobile device 12 are expanded by thesame laser diode projector 64 that generates the second series of lightoutputs corresponding to a virtual keyboard key arrangement 66. Thelight outputs of the virtual keyboard are projected against the frontdisplay surface 20 b, and specifically the keyboard projection surfaceof the second section 20 of the clamshell structure 16. The set ofdiffractive optic elements 68 are aligned with the output end of thelaser diode projector 64 and the virtual keyboard projection aperture 38defined in the second lengthwise edge wall 30 of the housing 26.

The fourth embodiment of the bi-directional projection unit 24 d alsoincorporates the IR detector 70 and the CMOS imaging sensor 72 thatdetermines key inputs that are captured by the input processor 74 andrelayed to the mobile device 12 by the communications module 52. Again,it is understood that the break in the laser projection from the laserdiode projector 64 is detected by the IR detector 70, and the CMOSimaging sensor 72 captures a sequence of images within its field of viewthat are processed to determine the haptic inputs upon the virtualkeyboard key arrangement 66. The IR detector 70 is positioned within thehousing 26 to be aligned with the second sensor aperture 42, while theCMOS imaging sensor 72 is positioned to be aligned with the first sensoraperture 40.

The pico projector 44 is mounted to a pair of thermal conductors or heatsinks 60 a, 60 b to transfer away the heat generated thereby. The laserdiode projector 64 is mounted to a pair of thermal conductors or heatsinks 60 c, 60 d to transfer away the heat generated thereby. Similar tothe second embodiment discussed above, however, the fourth embodimentdoes not include any fans, and relies entirely on the heat sinks 60 andit direct or indirect thermal conduction to ambient air.

Regardless of the variations in the bi-directional projection unit 24discussed above, the present disclosure contemplates a portable means toleverage a single device, e.g., a smartphone, as a primary computingdevice for various information workers, though in particular those thatcannot be tethered to a single desktop such as sales and consultingprofessionals. The portability of the bi-directional projection unit 24,as well as the overall apparatus 10, can be leveraged for improvedmobility. The display of the mobile device 12 can be mirrored andexpanded to the clamshell structure 16, and a larger virtual keyboardexpands the input capabilities to a wider range provided by the sameclamshell structure 16.

One example use case contemplated the user performing demonstrations ofcontent from the mobile device 12 to a large room or audience. Theincorporated pico projector 44 is envisioned to project the video outputfrom the mobile device to a large, distant surface. Additionally,another use case contemplates a more intimate setting, e.g., two people,in which the video output is projected to a nearby surface. Stillanother use case contemplates a single user in which the video output isprojected on to the clamshell structure 16. In various embodiments ofthe present disclosure, the mobile device 12 is envisioned to serve asthe primary computing device as a slim and ultralight alternative tolaptop computers and other full-featured mobile devices such as tabletsand phablets.

The particulars shown herein are by way of example and for purposes ofillustrative discussion of the embodiments of the mobile device displayand input expansion apparatus and are presented in the cause ofproviding what is believed to be the most useful and readily understooddescription of the principles and conceptual aspects. In this regard, noattempt is made to show details with more particularity than isnecessary, the description taken with the drawings making apparent tothose skilled in the art how the several forms of the present disclosuremay be embodied in practice.

1-22. (canceled)
 23. An input and output expander, comprising: aclamshell structure including a first section in a hinged relationshipto a second section, the first section defining a flat displayprojection surface and the second section defining a dock and a keyboardprojection surface; and a bi-directional projection unit connectible toan external device, including: a display output projector connectible tothe external device, output display signal therefrom being converted toa first series of light outputs corresponding to the output displaysignal and projected against the flat display projection surface of theclamshell structure, a virtual keyboard projector generating a secondseries of light outputs corresponding to a virtual keyboard keyarrangement and projected against the keyboard projection surface of thesecond section of the clamshell structure; a key input sensor coveringthe virtual keyboard key arrangement to detect haptic input at specificpositions along the virtual keyboard key arrangement, the key inputsensor generating a key input value corresponding to a specific key ofthe virtual keyboard key arrangement at which the haptic input isdetected, the key input value being relayed to the external device. 24.The input and output expander of claim 23, wherein the bi-directionalprojection unit includes: a transceiver in communication with theexternal device, the output display signals from, and the input signalsto the external device being relayed by the transceiver.
 25. The inputand output expander of claim 24, wherein the transceiver is wireless, awireless communication link over which the output display signals andthe input signals between the transceiver and the external device arecommunicated.
 26. The input and output expander of claim 23, wherein thetransceiver of the bi-directional projection unit includes an interfaceport receptive to an input/output link connector connectible to theexternal device.
 27. The input and output expander of claim 23, whereinthe bi-directional projection unit includes a housing separate from theclamshell structure.
 28. The input and output expander of claim 27,wherein the bi-directional projection unit includes a printed circuitboard enclosed within the housing, and the display output projector, thevirtual keyboard projector, and the key input sensor are mounted to theprinted circuit board.
 29. The input and output expander of claim 27,wherein the bi-directional projection unit includes an air circulatormounted in the housing with an output facing an exterior of the housing.30. The input and output expander of claim 27, wherein the housingdefines a recess receptive to the external device.
 31. The input andoutput expander of claim 23, wherein the bi-directional projection unitincludes one or more thermal conductors mounted to at least one or bothof the virtual keyboard projector and display output projector.
 32. Theinput and output expander of claim 23, wherein the virtual keyboardprojector includes a laser emitter.
 33. The input and output expander ofclaim 32, wherein the key input sensor is an infrared detector capturingbreaks in laser emissions from the laser emitter corresponding to aphysical interference thereof by the haptic input.
 34. The input andoutput expander of claim 23, wherein the key input sensor is a visiblelight imaging sensor capturing a continuous sequence of images atdiscrete sampling instances and a visual field encompassing the virtualkeyboard key arrangement as projected on to the keyboard projectionsurface.
 35. An input and output expander for an external device,comprising: a display output projector, output display signals from theexternal device being converted to a first series of light outputscorresponding to the output display signal; a virtual keyboard projectorgenerating a second series of light outputs corresponding to a virtualkeyboard key arrangement; and a key input sensor defining a sensingcoverage area encompassing a projection of the virtual keyboard keyarrangement to detect user input at specific positions thereon, the keyinput sensor generating a key input value corresponding to a specifickey of the virtual keyboard key arrangement at which the user input isdetected, the key input value being relayed to the external device. 36.The input and output expander of claim 35, further comprising: atransceiver in communication with the external device, the outputdisplay signals from, and the input signals to the external device beingrelayed by the transceiver.
 37. The input and output expander of claim36, wherein the transceiver is wireless, a wireless communication linkover which the output display signals and the input signals between thetransceiver and the external device are communicated.
 38. The input andoutput expander of claim 36, wherein the transceiver has an interfaceport receptive to an input/output link connector connectible to theexternal device.
 39. The input and output expander of claim 36, furthercomprising a housing with a display projector aperture to the displayoutput projector, a keyboard projection aperture to the virtual keyboardprojector, and an input sensor aperture to the input sensor.
 40. Theinput and output expander of claim 37, further comprising a printedcircuit board enclosed within the housing, on which the display outputprojector, the virtual keyboard projector, and the key input sensor aremounted.
 41. The input and output expander of claim 36, wherein thehousing defines a recess receptive to the external device.
 42. The inputand output expander of claim 39, further comprising a sensor mountingplatform with the key input sensor attached thereto and being extendableabove a top plane of the housing.